1 Data

A total of 302 participants each completed all 12 estimation questions for a total of 3624 estimations.

participant_id q_id creature dataset scale response qtext true_value
0f7fc4ff03ad53f80b84cc62c1644648 Q0 ewok dataset1 log2 10000 Between 30 and 40 ABY, how does the population of Ewoks change? NA
0f7fc4ff03ad53f80b84cc62c1644648 QE1 ewok dataset1 log2 500 What is the population of Ewoks in 10 ABY? 481.62
0f7fc4ff03ad53f80b84cc62c1644648 QE2 ewok dataset1 log2 24 In what ABY does the population of Ewoks reach 4,000? 28.45
0f7fc4ff03ad53f80b84cc62c1644648 QI2 ewok dataset1 log2 16 How many times more Ewoks are there in 40 ABY than in 20 ABY? 10.69
0f7fc4ff03ad53f80b84cc62c1644648 QI3 ewok dataset1 log2 6 How long does it take for the population of Ewoks in 10 ABY to double? 6.25
0f7fc4ff03ad53f80b84cc62c1644648 QI1 ewok dataset1 log2 14848 From 20 ABY to 40 ABY, the population increases by ____ Ewoks. 14363.34

2 Check Randomization

participant_id N Q0-linear Q0-log2 QE1-linear QE1-log2 QE2-linear QE2-log2 QI1-linear QI1-log2 QI2-linear QI2-log2 QI3-linear QI3-log2
007d07c3cb1ae3fc41cd3d0fc21ff9c0 12 1 1 1 1 1 1 1 1 1 1 1 1
0105fdd1615f6dddc116dc6e636aaabb 12 1 1 1 1 1 1 1 1 1 1 1 1
0148e4dc77c5c94b4e243ade4ca2f5ee 12 1 1 1 1 1 1 1 1 1 1 1 1
08369279e8a82a348615711c7fc95c82 12 1 1 1 1 1 1 1 1 1 1 1 1
09a0815ca17719dfc5706a6a5bf85781 12 1 1 1 1 1 1 1 1 1 1 1 1
0a66022c91eaf41f62ac705d6ae1a586 12 1 1 1 1 1 1 1 1 1 1 1 1
0ad5b22507b197ea9c767efe6940dada 12 1 1 1 1 1 1 1 1 1 1 1 1
0bf9d88a61134650cd5255ae3dd9928f 12 1 1 1 1 1 1 1 1 1 1 1 1
0c373c177d39dae861b524129a7689dc 12 1 1 1 1 1 1 1 1 1 1 1 1
0d25abb468924ad9bf6edd90fcbc05c9 12 1 1 1 1 1 1 1 1 1 1 1 1
0db48d3cd6b1404ffde760b097f88af1 12 1 1 1 1 1 1 1 1 1 1 1 1
0e218ab64a2ee58fbab334f5bf5c152e 12 1 1 1 1 1 1 1 1 1 1 1 1
0ecdd80d13504ba1b585380af4851bd1 12 1 1 1 1 1 1 1 1 1 1 1 1
0f7fc4ff03ad53f80b84cc62c1644648 12 1 1 1 1 1 1 1 1 1 1 1 1
0fa34f7cd0193e9fed194a6ccddff268 12 1 1 1 1 1 1 1 1 1 1 1 1
10492f32b686594b8ed96a8d8569209e 12 1 1 1 1 1 1 1 1 1 1 1 1
1080732b4cf6fb35cc49ab3386dd5ea4 12 1 1 1 1 1 1 1 1 1 1 1 1
110c1aa8f2cf7f715f3b007c13b3e4b4 12 1 1 1 1 1 1 1 1 1 1 1 1
1170ca039a240369ed597062ba51964a 12 1 1 1 1 1 1 1 1 1 1 1 1
119566b65825d2ca79cb93940c52e2be 12 1 1 1 1 1 1 1 1 1 1 1 1
12fbacb2ffcdf84286a8dee9a53b716b 12 1 1 1 1 1 1 1 1 1 1 1 1
136c5e197ed26cea6ddefa13b894dd17 12 1 1 1 1 1 1 1 1 1 1 1 1
1445188df8e9154ca6664e3dcdf2b55a 12 1 1 1 1 1 1 1 1 1 1 1 1
14663e87d0961d9a29fe7e95615726f0 12 1 1 1 1 1 1 1 1 1 1 1 1
147568084cb7b92fc71650ede6d79402 12 1 1 1 1 1 1 1 1 1 1 1 1
157bb1a0908faf70776afe2727da669e 12 1 1 1 1 1 1 1 1 1 1 1 1
162e0b3089a3719ece5f296ca5f28681 12 1 1 1 1 1 1 1 1 1 1 1 1
16da5e980206f7e41c4d7fd756fbf6ae 12 1 1 1 1 1 1 1 1 1 1 1 1
16e5b03d85e7bd3fe645b6672bfa4f54 12 1 1 1 1 1 1 1 1 1 1 1 1
191bf5769e607e9c09defbd5ef6f9f6d 12 1 1 1 1 1 1 1 1 1 1 1 1
19806e3b615d12a687465bed74b5c48b 12 1 1 1 1 1 1 1 1 1 1 1 1
19a9404eb028a8c1e6b673757a26d40b 12 1 1 1 1 1 1 1 1 1 1 1 1
1a67677d3a3d7192b3547d279a6f4cfe 12 1 1 1 1 1 1 1 1 1 1 1 1
1b19c679abb207159be1ed61531f17b6 12 1 1 1 1 1 1 1 1 1 1 1 1
1b3980739a000ffd65b5744b7b918fd8 12 1 1 1 1 1 1 1 1 1 1 1 1
1cc58e6632b56f32caa1532f370de243 12 1 1 1 1 1 1 1 1 1 1 1 1
1da48ce70489857637240dc0642c8af5 12 1 1 1 1 1 1 1 1 1 1 1 1
1daa8c2e1a4b5dc35652763fe1d326f1 12 1 1 1 1 1 1 1 1 1 1 1 1
1e88f530f60effa64127ea0ea7d9dc1f 12 1 1 1 1 1 1 1 1 1 1 1 1
1f4ea9e5093a07d34572c679cbca1c77 12 1 1 1 1 1 1 1 1 1 1 1 1
1f9ac3d8bc1f5c53e80fffcb65bb8fe0 12 1 1 1 1 1 1 1 1 1 1 1 1
22141e4c915a2de93dbaf49140e6e35f 12 1 1 1 1 1 1 1 1 1 1 1 1
223fd1390046c3b5ca80060b1df07201 12 1 1 1 1 1 1 1 1 1 1 1 1
24dfa007726c6d964b31d4c118a84a5e 12 1 1 1 1 1 1 1 1 1 1 1 1
25a6eeffa962846b0e5571b1e8f67013 12 1 1 1 1 1 1 1 1 1 1 1 1
261a45fcbcb24e3f58196143645a77e4 12 1 1 1 1 1 1 1 1 1 1 1 1
2869e0d272add47507968d413fe6e3d7 12 1 1 1 1 1 1 1 1 1 1 1 1
28bf726717a669356378b71e7f0d5fa9 12 1 1 1 1 1 1 1 1 1 1 1 1
29572e304b0e61bcdb2a079c609e458c 12 1 1 1 1 1 1 1 1 1 1 1 1
2a1e0574772f75d1e75a20bbf67e5083 12 1 1 1 1 1 1 1 1 1 1 1 1
2aa9fca7066ab5a9b6ba585f32206a36 12 1 1 1 1 1 1 1 1 1 1 1 1
2fa954fdb92e6fc21975c9b3825b94ca 12 1 1 1 1 1 1 1 1 1 1 1 1
2fd72874d0f6c5eea0102ef953ca99ad 12 1 1 1 1 1 1 1 1 1 1 1 1
307cc01521359820b71e3cac84a9d6fc 12 1 1 1 1 1 1 1 1 1 1 1 1
30eba544c6ad93a202ddd65359e841f6 12 1 1 1 1 1 1 1 1 1 1 1 1
32504d7140a6f398da78de6a9cdda64c 12 1 1 1 1 1 1 1 1 1 1 1 1
32786833d01593eed29bfd56471a6351 12 1 1 1 1 1 1 1 1 1 1 1 1
32ed6b61b27c360e93a8554dc1c67150 12 1 1 1 1 1 1 1 1 1 1 1 1
3300de3f641bb5c081396477526af9a7 12 1 1 1 1 1 1 1 1 1 1 1 1
33b57499ee2e8aa0fc06fa1240192cb5 12 1 1 1 1 1 1 1 1 1 1 1 1
3744a5639a5e7899d5c71e44c0636f50 12 1 1 1 1 1 1 1 1 1 1 1 1
38bd2368a73b5986d155cf482c008a3d 12 1 1 1 1 1 1 1 1 1 1 1 1
3a03e41666487c42def19e4836cee9d9 12 1 1 1 1 1 1 1 1 1 1 1 1
3c1f03ef1470fe0c98385f15299f3bd7 12 1 1 1 1 1 1 1 1 1 1 1 1
3cd9e4914dac5f41cc49b469b38fe28e 12 1 1 1 1 1 1 1 1 1 1 1 1
409788e1fd3255a886e3af7757137c36 12 1 1 1 1 1 1 1 1 1 1 1 1
4167f444dbcb9b3cf0d6f97044a7f42b 12 1 1 1 1 1 1 1 1 1 1 1 1
4285d7fe9eb296e55441482d88372ca1 12 1 1 1 1 1 1 1 1 1 1 1 1
42ab02f90633fc0968e2029c48822f71 12 1 1 1 1 1 1 1 1 1 1 1 1
4376f0a456d76e52ee6255b5194f7a3c 12 1 1 1 1 1 1 1 1 1 1 1 1
43e5875635266f49bcc05fa9007d162f 12 1 1 1 1 1 1 1 1 1 1 1 1
446dbd66f9b0592c9fa55805477cd056 12 1 1 1 1 1 1 1 1 1 1 1 1
44b2126907638ed767266a1146265d76 12 1 1 1 1 1 1 1 1 1 1 1 1
4528a0cfc685bf6b5968254b538ab234 12 1 1 1 1 1 1 1 1 1 1 1 1
45d1ac88edd2676feff84a844798a5d4 12 1 1 1 1 1 1 1 1 1 1 1 1
485661bb269b630ebd9660c3b20962fe 12 1 1 1 1 1 1 1 1 1 1 1 1
486ed52ab1f564cbbc032af43541ec36 12 1 1 1 1 1 1 1 1 1 1 1 1
4bbb57a42f8024b442db42fc157d3664 12 1 1 1 1 1 1 1 1 1 1 1 1
4d2d74e653929655bca44e4a3216c21f 12 1 1 1 1 1 1 1 1 1 1 1 1
4d37451da76162a30bd8331046d1efb6 12 1 1 1 1 1 1 1 1 1 1 1 1
4dd63656cf06baf97ac3575da5e6c3e1 12 1 1 1 1 1 1 1 1 1 1 1 1
4e73b5417a92593bb76b4cef7f3bb677 12 1 1 1 1 1 1 1 1 1 1 1 1
4e9d68a2b642791014dfba3aa5f1cb9e 12 1 1 1 1 1 1 1 1 1 1 1 1
4f1e3f577ef9aca484ea72c725406afc 12 1 1 1 1 1 1 1 1 1 1 1 1
50f2a079e08f902d264e62fa9d39a604 12 1 1 1 1 1 1 1 1 1 1 1 1
5355fff05b9157b6d8d3ea0b10bb2dc0 12 1 1 1 1 1 1 1 1 1 1 1 1
53bf21c347f5c27f43db801904b1b13d 12 1 1 1 1 1 1 1 1 1 1 1 1
541291b6a4cfdeffc0a35d03eb1d2833 12 1 1 1 1 1 1 1 1 1 1 1 1
555565a7cc878dd74672ad9b6c123e45 12 1 1 1 1 1 1 1 1 1 1 1 1
55db15fdca19bd62e90cae731783250c 12 1 1 1 1 1 1 1 1 1 1 1 1
56b656fa3c518956942e836f404e2a3c 12 1 1 1 1 1 1 1 1 1 1 1 1
5888e162ac2d004bae84f10478635051 12 1 1 1 1 1 1 1 1 1 1 1 1
58f409842fc342ce1210012837de9c2a 12 1 1 1 1 1 1 1 1 1 1 1 1
59cb13cc8508ffccc1493c8f86701571 12 1 1 1 1 1 1 1 1 1 1 1 1
5a8068b61406671ef2c8a9a100890d9e 12 1 1 1 1 1 1 1 1 1 1 1 1
5b16d305db2092ddae8cf1c410341f36 12 1 1 1 1 1 1 1 1 1 1 1 1
5be330a72a9aa7217ad06b9b143e1cd9 12 1 1 1 1 1 1 1 1 1 1 1 1
5c9204caf335a1288c7eb2d91e7ea55e 12 1 1 1 1 1 1 1 1 1 1 1 1
5ce609972fa70dbdcad9f4fb623b73ba 12 1 1 1 1 1 1 1 1 1 1 1 1
5d84d322860d4bc59a6d18912bd821e6 12 1 1 1 1 1 1 1 1 1 1 1 1
5e60c06b708788eaee2bb3a8c2436193 12 1 1 1 1 1 1 1 1 1 1 1 1
5e701f78bc5d04223ce91269893560a4 12 1 1 1 1 1 1 1 1 1 1 1 1
5efa88925fcf8d825d8c784e494f1782 12 1 1 1 1 1 1 1 1 1 1 1 1
5f4c3a382c6ed5e74a21bfd16d8fc17e 12 1 1 1 1 1 1 1 1 1 1 1 1
611a564830fcedc01089809286bab8ef 12 1 1 1 1 1 1 1 1 1 1 1 1
6127b669adcf4df35b9f41096b88626f 12 1 1 1 1 1 1 1 1 1 1 1 1
62854f480428a3385f1c7acc859fb2b2 12 1 1 1 1 1 1 1 1 1 1 1 1
64eb32aceabca68746f4a150a230a0bf 12 1 1 1 1 1 1 1 1 1 1 1 1
67faa93c00ae178c80e249b529c4e84a 12 1 1 1 1 1 1 1 1 1 1 1 1
6858c6d2ae8e6e10be0d6d8dc8b02f08 12 1 1 1 1 1 1 1 1 1 1 1 1
68927a6dbecdff411485141b31c14708 12 1 1 1 1 1 1 1 1 1 1 1 1
6996519a1258f5cda258d066dcedf149 12 1 1 1 1 1 1 1 1 1 1 1 1
6a549d2a37c37010d3e2852d2e1b2588 12 1 1 1 1 1 1 1 1 1 1 1 1
6b93da75faf9627d83af040454b64889 12 1 1 1 1 1 1 1 1 1 1 1 1
6c4dffc06bf708a586d169b7c8dbade7 12 1 1 1 1 1 1 1 1 1 1 1 1
6c5775ce915d8af1544a3ba68df627d9 12 1 1 1 1 1 1 1 1 1 1 1 1
6dd0787021d085f4a534a85c125fffc3 12 1 1 1 1 1 1 1 1 1 1 1 1
6e15348465abd11617cc1c03f1ddae0a 12 1 1 1 1 1 1 1 1 1 1 1 1
6eee0b36cd9107ff3cbee2c88d65e50b 12 1 1 1 1 1 1 1 1 1 1 1 1
6f70a1ab89a256dcca121c55d0ed81e3 12 1 1 1 1 1 1 1 1 1 1 1 1
70356549a4326b484b73c0305e353711 12 1 1 1 1 1 1 1 1 1 1 1 1
717ca55ff5db8ce3e2adbc0bf488a81b 12 1 1 1 1 1 1 1 1 1 1 1 1
71c68cd2f2dd20bdb96cb759ddc135ff 12 1 1 1 1 1 1 1 1 1 1 1 1
729cd264acb09fee65dc9ba92bf648db 12 1 1 1 1 1 1 1 1 1 1 1 1
7334c1ff19548672989325f1f04cd425 12 1 1 1 1 1 1 1 1 1 1 1 1
756aea97158766c5d0ed265bd7b3ed5a 12 1 1 1 1 1 1 1 1 1 1 1 1
762c737d6b1123d81fe5d66c2263b644 12 1 1 1 1 1 1 1 1 1 1 1 1
76f8dfd88285cbccd7f8e1bb513700e7 12 1 1 1 1 1 1 1 1 1 1 1 1
771546ab00409d55697c6c3f3e5b8592 12 1 1 1 1 1 1 1 1 1 1 1 1
77374b9d7c212c32cf34b9bb3372e3b1 12 1 1 1 1 1 1 1 1 1 1 1 1
7847dfebdb5ea81d51c2c754c31ffd8b 12 1 1 1 1 1 1 1 1 1 1 1 1
78921df13c7670970158956bff5c8fbd 12 1 1 1 1 1 1 1 1 1 1 1 1
78adc13f39e5f31a16c8e46cd17e69f3 12 1 1 1 1 1 1 1 1 1 1 1 1
78f0a77edeb75f24fc87567b444c152a 12 1 1 1 1 1 1 1 1 1 1 1 1
7926b57f87c3e3330c7546efc62d93d8 12 1 1 1 1 1 1 1 1 1 1 1 1
7939cdcd5516161eb97fdaa411d3c423 12 1 1 1 1 1 1 1 1 1 1 1 1
79c96ce1efd1801ea6af6fc426840fec 12 1 1 1 1 1 1 1 1 1 1 1 1
7a0026efb04c4e98b7275663a297277c 12 1 1 1 1 1 1 1 1 1 1 1 1
7b4f0e847a63e49d01ba8d7c857de7f3 12 1 1 1 1 1 1 1 1 1 1 1 1
7b53106fce10fcd6f52b4a0cf5cb9cea 12 1 1 1 1 1 1 1 1 1 1 1 1
7c8cf17fca66466d7c4b282ad7e24793 12 1 1 1 1 1 1 1 1 1 1 1 1
7d298109128e082d3368ad4142d41114 12 1 1 1 1 1 1 1 1 1 1 1 1
7d98ecc6753c4dd8b2dc3f0fcd0ba717 12 1 1 1 1 1 1 1 1 1 1 1 1
7db144a476ddf5b531f4284847f56b71 12 1 1 1 1 1 1 1 1 1 1 1 1
7dd5743c51ebce48019d913ee646c98f 12 1 1 1 1 1 1 1 1 1 1 1 1
7f168369ca51c14a22e410e23c863384 12 1 1 1 1 1 1 1 1 1 1 1 1
80221ccd89237f733235ed32b12dd070 12 1 1 1 1 1 1 1 1 1 1 1 1
81cb45ebdd654b7003743767d684a6da 12 1 1 1 1 1 1 1 1 1 1 1 1
82a589a49bab6dd43a25fc73df0ceaf2 12 1 1 1 1 1 1 1 1 1 1 1 1
8410b9d4686ffb9eb9473ccd7eb29246 12 1 1 1 1 1 1 1 1 1 1 1 1
845174d0755025108d20413c2999a3f1 12 1 1 1 1 1 1 1 1 1 1 1 1
853e83b70e5c582ce8730c25ea34f74e 12 1 1 1 1 1 1 1 1 1 1 1 1
855557c5e0887be4d9ba17aa37202521 12 1 1 1 1 1 1 1 1 1 1 1 1
8578156276300eddceb6011edda33d2a 12 1 1 1 1 1 1 1 1 1 1 1 1
85af13c4eaa0a0e4235f27b984b1118d 12 1 1 1 1 1 1 1 1 1 1 1 1
85c5d4e6226293f262c22bda603f2741 12 1 1 1 1 1 1 1 1 1 1 1 1
869e5f83a0125f86655912106d7666bc 12 1 1 1 1 1 1 1 1 1 1 1 1
883a69220c4052cfc732363f20490631 12 1 1 1 1 1 1 1 1 1 1 1 1
88af59add4d83e5164eeee82a0c31330 12 1 1 1 1 1 1 1 1 1 1 1 1
88e5cc180226df649d2c9f8aad22516d 12 1 1 1 1 1 1 1 1 1 1 1 1
899fe9e279a9f72784409e5a41b16249 12 1 1 1 1 1 1 1 1 1 1 1 1
89ea0acd444eea06952aedde035b6b0d 12 1 1 1 1 1 1 1 1 1 1 1 1
89ee882bcfb1d232a8b99ffda5823120 12 1 1 1 1 1 1 1 1 1 1 1 1
89f5d5b98401ba285cf4761c4c03d1f2 12 1 1 1 1 1 1 1 1 1 1 1 1
8ab3438eb60817740bdd15143ceacd06 12 1 1 1 1 1 1 1 1 1 1 1 1
8bedc31b883ddd22fe9809a4ee91c833 12 1 1 1 1 1 1 1 1 1 1 1 1
8c9fad9f19ca77d8cc4f53bb2ead5f86 12 1 1 1 1 1 1 1 1 1 1 1 1
8d11e78049ec6adef2f83eb0b0206222 12 1 1 1 1 1 1 1 1 1 1 1 1
8dc6dd7b2b1521e15dd14e25f024f918 12 1 1 1 1 1 1 1 1 1 1 1 1
8ee9cf2ff7732303bede8cbc48a39155 12 1 1 1 1 1 1 1 1 1 1 1 1
8f9fbe653fe27fccaf853a5b8be8706d 12 1 1 1 1 1 1 1 1 1 1 1 1
8ffdb8600df91213be7b73147000a012 12 1 1 1 1 1 1 1 1 1 1 1 1
9001292d6009cd1b81bc541394e771db 12 1 1 1 1 1 1 1 1 1 1 1 1
905e275c72e141464c71d6ff2e564152 12 1 1 1 1 1 1 1 1 1 1 1 1
907b1547f0ea4ca90f33b3f5f0ea1cfc 12 1 1 1 1 1 1 1 1 1 1 1 1
9148a09851f4618c8769333287a85239 12 1 1 1 1 1 1 1 1 1 1 1 1
91c6d3ea4e39fb021fc87d3074cb1707 12 1 1 1 1 1 1 1 1 1 1 1 1
91f417bfd153026480907685ce81e781 12 1 1 1 1 1 1 1 1 1 1 1 1
9229d338e5b53243ab93731c74f24fa0 12 1 1 1 1 1 1 1 1 1 1 1 1
93055f8c1ce073b921741b413617fefa 12 1 1 1 1 1 1 1 1 1 1 1 1
935daa8e42f5b5c4cb611be63fc2c27a 12 1 1 1 1 1 1 1 1 1 1 1 1
936f43e32353425529279709099cd99e 12 1 1 1 1 1 1 1 1 1 1 1 1
93841b3a8783a55e1b37b9fc1c864d1a 12 1 1 1 1 1 1 1 1 1 1 1 1
93b2e31088054d864e18d888b96833f6 12 1 1 1 1 1 1 1 1 1 1 1 1
940b450d1f4d6762317cc7f96d7e35cf 12 1 1 1 1 1 1 1 1 1 1 1 1
94d2d42771da1f3e8dd6d66aef063a28 12 1 1 1 1 1 1 1 1 1 1 1 1
95f895aaed3a583fa40d2f9498fdcfc6 12 1 1 1 1 1 1 1 1 1 1 1 1
964ae4ba09cd674e17fa5357f61bdec8 12 1 1 1 1 1 1 1 1 1 1 1 1
968d2437e702bfe788acf6fc5fd76337 12 1 1 1 1 1 1 1 1 1 1 1 1
9a677cada95ae4c374279b5da3826531 12 1 1 1 1 1 1 1 1 1 1 1 1
9a98a72161e05f451935f9774715c312 12 1 1 1 1 1 1 1 1 1 1 1 1
9b14a90a0d04cda3ff5e40954683641d 12 1 1 1 1 1 1 1 1 1 1 1 1
9b40706a32bc07b67d6aaabd7341aed6 12 1 1 1 1 1 1 1 1 1 1 1 1
9b4fb877ae97c2d8777ad18f8d63c932 12 1 1 1 1 1 1 1 1 1 1 1 1
9c5c9e7c0f69549a27f71bfba934daca 12 1 1 1 1 1 1 1 1 1 1 1 1
9e349d554390cb8e86f2504554757ab0 12 1 1 1 1 1 1 1 1 1 1 1 1
9f90826d57d65adc00b15f2badfbce99 12 1 1 1 1 1 1 1 1 1 1 1 1
a034dbfc061a1d18a1054735cc92dd46 12 1 1 1 1 1 1 1 1 1 1 1 1
a1b07a3433315f47073f12f23322d8b6 12 1 1 1 1 1 1 1 1 1 1 1 1
a2a79000165845aedd84bff949b18f84 12 1 1 1 1 1 1 1 1 1 1 1 1
a2e7db2cb232e6af210058f6b9a4dd76 12 1 1 1 1 1 1 1 1 1 1 1 1
a6789edde93904626eb8edfba9e53a22 12 1 1 1 1 1 1 1 1 1 1 1 1
a74c5b689c1a8e292974d2088a2a027b 12 1 1 1 1 1 1 1 1 1 1 1 1
a7c602015bf3cf255ef84b0b83f5945f 12 1 1 1 1 1 1 1 1 1 1 1 1
a8bd2426e919b930fb32e084a0ef98d1 12 1 1 1 1 1 1 1 1 1 1 1 1
aa0a96c460d49c9cdab5996785245d52 12 1 1 1 1 1 1 1 1 1 1 1 1
adc6461149c0bea8644332de1aa6196a 12 1 1 1 1 1 1 1 1 1 1 1 1
aeeeb182dc2bcda4494b599c13cd3820 12 1 1 1 1 1 1 1 1 1 1 1 1
af74ac17f7f04b842ee22d53f4a485b4 12 1 1 1 1 1 1 1 1 1 1 1 1
b07a9e94187a0614519a18bd61af17d7 12 1 1 1 1 1 1 1 1 1 1 1 1
b20934b5666d56c9509c2ded85627631 12 1 1 1 1 1 1 1 1 1 1 1 1
b3b1c5c0d48941a81492ab282b34516a 12 1 1 1 1 1 1 1 1 1 1 1 1
b463f6241880dcbedd3d5225b1e620ee 12 1 1 1 1 1 1 1 1 1 1 1 1
b4d1316064f10d7976c1803d44c20fa1 12 1 1 1 1 1 1 1 1 1 1 1 1
b56df533d46c6c2155548dc22047c95e 12 1 1 1 1 1 1 1 1 1 1 1 1
b643d914fccbb31d1d5653dab27cdda1 12 1 1 1 1 1 1 1 1 1 1 1 1
b68213d7c881c753899042b9ab85563a 12 1 1 1 1 1 1 1 1 1 1 1 1
b9a3f6c6ee5f04b08a370da2cae8663d 12 1 1 1 1 1 1 1 1 1 1 1 1
ba99e784bdf14ceaa6a568c657794df4 12 1 1 1 1 1 1 1 1 1 1 1 1
bafb3fcec5ce1e37619b85ea6e9b2899 12 1 1 1 1 1 1 1 1 1 1 1 1
bc964336f3ce15842c473e827d28adf6 12 1 1 1 1 1 1 1 1 1 1 1 1
bcaa8899777af850f8464f6b83c9a9b9 12 1 1 1 1 1 1 1 1 1 1 1 1
be3b04fa071aff63e01b0ab957f5b935 12 1 1 1 1 1 1 1 1 1 1 1 1
be7f9543511bc58fa62d063a8fcb5dfb 12 1 1 1 1 1 1 1 1 1 1 1 1
beee3325e17f9efee16531ba2a4bff6b 12 1 1 1 1 1 1 1 1 1 1 1 1
beef7d22aeb1bf2a7f1c0c3f0f68944c 12 1 1 1 1 1 1 1 1 1 1 1 1
bfd137cfd9ec3c8ae9a7ee6a460db6bf 12 1 1 1 1 1 1 1 1 1 1 1 1
bff6722bf30bc16bb9a79df0e246ac3e 12 1 1 1 1 1 1 1 1 1 1 1 1
c2075de344181756d8f9c4ebdf59a283 12 1 1 1 1 1 1 1 1 1 1 1 1
c25b3c821c111daedc3d0df8c0989a0d 12 1 1 1 1 1 1 1 1 1 1 1 1
c46052aa900e3fe309b29c697b6669bf 12 1 1 1 1 1 1 1 1 1 1 1 1
c4b68afd9078132a98d13fb618cb8454 12 1 1 1 1 1 1 1 1 1 1 1 1
c4f4a0b33e136aaf617ac7c2c0c15897 12 1 1 1 1 1 1 1 1 1 1 1 1
c587f7775b0ef6550fde4d6dd5f76d3a 12 1 1 1 1 1 1 1 1 1 1 1 1
c65a792193b1b6e2bfbe3e91ed1dc801 12 1 1 1 1 1 1 1 1 1 1 1 1
c6ce67bf0a40d1b60835f5b020c00787 12 1 1 1 1 1 1 1 1 1 1 1 1
c7eab425c00176a18164c2c7c2035d58 12 1 1 1 1 1 1 1 1 1 1 1 1
c870395cd4fd84c963efd92dcd8e8ec4 12 1 1 1 1 1 1 1 1 1 1 1 1
c9775b8f8bbd022d36947f740be094f8 12 1 1 1 1 1 1 1 1 1 1 1 1
c9c6e7836c772140930e7e9477905a7a 12 1 1 1 1 1 1 1 1 1 1 1 1
ca8cc3f37aba5bb3141cb4ca628dcca5 12 1 1 1 1 1 1 1 1 1 1 1 1
cc7a4a5e201423a6aceaaa93fa895afc 12 1 1 1 1 1 1 1 1 1 1 1 1
cd8313f9656af103cbc65da47ab2e4c5 12 1 1 1 1 1 1 1 1 1 1 1 1
ce04f073c1a7b4f49ba4c72013fc83aa 12 1 1 1 1 1 1 1 1 1 1 1 1
ce982d363c2870232d99d2537d269018 12 1 1 1 1 1 1 1 1 1 1 1 1
cf59a1fc753bf0e0a0620262f128bdbe 12 1 1 1 1 1 1 1 1 1 1 1 1
cfb2098b729f94fbec58a0ba8963fc9b 12 1 1 1 1 1 1 1 1 1 1 1 1
d062f27d3473c92ac0dd7cd6c71dac01 12 1 1 1 1 1 1 1 1 1 1 1 1
d06c0f0b52b05dcec07928acf3021b85 12 1 1 1 1 1 1 1 1 1 1 1 1
d0a2e48f39d72b7a61be63f1ab9c184c 12 1 1 1 1 1 1 1 1 1 1 1 1
d144a403a6cc7e92997ef7f47d3ae802 12 1 1 1 1 1 1 1 1 1 1 1 1
d3cc24b7daa4135b051b6c6066a18c29 12 1 1 1 1 1 1 1 1 1 1 1 1
d433fe11216bea99e16c88666e92ed1f 12 1 1 1 1 1 1 1 1 1 1 1 1
d5f92ca0c2faaee32ca721b73e331a03 12 1 1 1 1 1 1 1 1 1 1 1 1
d666b3d9b9e2a44bda1fa2f21703aa70 12 1 1 1 1 1 1 1 1 1 1 1 1
d8c11d82960a902ff5fe49bd631fbadb 12 1 1 1 1 1 1 1 1 1 1 1 1
d91879b8adbfbb225f5903015a042866 12 1 1 1 1 1 1 1 1 1 1 1 1
da23742f574b4c1900cd1cd5a0bde150 12 1 1 1 1 1 1 1 1 1 1 1 1
da36ddce30f7dfad89d3d320a165ec59 12 1 1 1 1 1 1 1 1 1 1 1 1
da88e8167cf61e7f5f960f2dbd4ff784 12 1 1 1 1 1 1 1 1 1 1 1 1
dbb2cfd8a02c3146f59cab9b4454e829 12 1 1 1 1 1 1 1 1 1 1 1 1
dbf5717965b3661db2b5cf612b46cba7 12 1 1 1 1 1 1 1 1 1 1 1 1
dc5fa03c5222fb6474d8bfeffe4a5d4f 12 1 1 1 1 1 1 1 1 1 1 1 1
dcb530a5c16759cddb9c36c89657404a 12 1 1 1 1 1 1 1 1 1 1 1 1
dcc33bdc7419ddf33e84a1c2fc3c1e43 12 1 1 1 1 1 1 1 1 1 1 1 1
dd914b9d74480978ef9adf6d493a2589 12 1 1 1 1 1 1 1 1 1 1 1 1
df4eb1fb62b238ff6b1389ec6a300f82 12 1 1 1 1 1 1 1 1 1 1 1 1
e242ac72647701842da5efc52e68c342 12 1 1 1 1 1 1 1 1 1 1 1 1
e4d2b800d1bfa67b51e2acbef7c442a6 12 1 1 1 1 1 1 1 1 1 1 1 1
e4d7d40cbaaa15235563665696672dad 12 1 1 1 1 1 1 1 1 1 1 1 1
e607c52475103ce06c1716309d8e589c 12 1 1 1 1 1 1 1 1 1 1 1 1
e6c99584e47809155225f090b1e010f8 12 1 1 1 1 1 1 1 1 1 1 1 1
e70ef3b899dac301e61ca18ab1fdeebf 12 1 1 1 1 1 1 1 1 1 1 1 1
e7322f8153589c4168e6f5c93fdd04ee 12 1 1 1 1 1 1 1 1 1 1 1 1
e7938842661ec63085ac14af1f4318a1 12 1 1 1 1 1 1 1 1 1 1 1 1
e7a794b5b9141de82b674285d32cee00 12 1 1 1 1 1 1 1 1 1 1 1 1
e84a462e5c7367b80687fa9ae89d9129 12 1 1 1 1 1 1 1 1 1 1 1 1
ec80c62ec6621f2d04d1215f6567402f 12 1 1 1 1 1 1 1 1 1 1 1 1
eca6ed1563373c730049b1948cade577 12 1 1 1 1 1 1 1 1 1 1 1 1
ece6a844b243e4b1bd61fb5e020fa906 12 1 1 1 1 1 1 1 1 1 1 1 1
f0b1bebbdd9246938c0af90f1f7acff9 12 1 1 1 1 1 1 1 1 1 1 1 1
f15b2ca149f5a80dda37d8719f6238a0 12 1 1 1 1 1 1 1 1 1 1 1 1
f15ead73193d951f776887e392ec7b9d 12 1 1 1 1 1 1 1 1 1 1 1 1
f1e50ee74d796ecc1dc192dbc1201b2a 12 1 1 1 1 1 1 1 1 1 1 1 1
f276c243e898e590652d35479cc08d24 12 1 1 1 1 1 1 1 1 1 1 1 1
f3aa3b9efdd8d75ea920f5367e136e62 12 1 1 1 1 1 1 1 1 1 1 1 1
f50aa95a6267b2aa42c5b668598dc686 12 1 1 1 1 1 1 1 1 1 1 1 1
f6fd124a269ae5ae5c8330278c002e55 12 1 1 1 1 1 1 1 1 1 1 1 1
f71595aff3f3d71a7ddb8631ee5c6802 12 1 1 1 1 1 1 1 1 1 1 1 1
f740c89d43b9ee0ff0a238bd72597693 12 1 1 1 1 1 1 1 1 1 1 1 1
f79a4c5a2fee9e4898755ad707af41a4 12 1 1 1 1 1 1 1 1 1 1 1 1
f8298201d86b15fdfa3afc97c8752139 12 1 1 1 1 1 1 1 1 1 1 1 1
f874d37cab84e8290317887525a4fd8e 12 1 1 1 1 1 1 1 1 1 1 1 1
f89edc1bb3af24cbe89effc94bfbf636 12 1 1 1 1 1 1 1 1 1 1 1 1
f94e9b8cdd1bdcbc649d7b4b767f2f83 12 1 1 1 1 1 1 1 1 1 1 1 1
fa95d8ade72623ea6e46c1b1b5893c1b 12 1 1 1 1 1 1 1 1 1 1 1 1
faf9c790edd0540aaa2c0c3a438dd51a 12 1 1 1 1 1 1 1 1 1 1 1 1
fb9da9c550ec6b24d03a4f2031136675 12 1 1 1 1 1 1 1 1 1 1 1 1
fc57cbeb7f26c4cc68c6297c99fa47b9 12 1 1 1 1 1 1 1 1 1 1 1 1
fcdccdcecacfc9e8ffb22a40e58abbdf 12 1 1 1 1 1 1 1 1 1 1 1 1
fdd6dce981e6def71a5db92bed4f117a 12 1 1 1 1 1 1 1 1 1 1 1 1
ff4065a6747c016006c4dbffc261a81d 12 1 1 1 1 1 1 1 1 1 1 1 1

3 Q0: Open Ended

q_id creature qtext true_value
Q0 tribble Between stardates 4530 and 4540, how does the population of Tribbles change? NA
Q0 ewok Between 30 and 40 ABY, how does the population of Ewoks change? NA

3.1 Linear Scale

## NULL

3.2 Log Scale

## NULL

4 QE1: Estimate a population given a year

4.1 Question

q_id creature qtext true_value
QE1 tribble What is the population of Tribbles in stardate 4510? 481.62
QE1 ewok What is the population of Ewoks in 10 ABY? 481.62

4.2 Closest Points

x y0 dataset y
3010 481.62 dataset1 445.48
3010 481.62 dataset2 466.90

4.3 Data

Truncated at 5000.

QE1 data set example
participant_id dataset scale response true_value deviation abs_deviation closest_pt_value closest_pt_deviation closest_pt_abs_deviation
0f7fc4ff03ad53f80b84cc62c1644648 dataset1 log2 500 481.62 18.38 18.38 445.48 54.52 54.52
0f7fc4ff03ad53f80b84cc62c1644648 dataset2 linear 500 481.62 18.38 18.38 466.90 33.10 33.10
5b16d305db2092ddae8cf1c410341f36 dataset1 log2 500 481.62 18.38 18.38 445.48 54.52 54.52
5b16d305db2092ddae8cf1c410341f36 dataset2 linear 400 481.62 -81.62 81.62 466.90 -66.90 66.90
8ab3438eb60817740bdd15143ceacd06 dataset2 log2 510 481.62 28.38 28.38 466.90 43.10 43.10
8ab3438eb60817740bdd15143ceacd06 dataset1 linear 800 481.62 318.38 318.38 445.48 354.52 354.52

4.4 Exploration

4.5 Main Take Aways

4.5.1 More varability in the estimation made on the linear scale

dataset scale variable n median iqr
dataset1 linear response 144 500 425
dataset1 log2 response 157 500 48
dataset2 linear response 157 500 400
dataset2 log2 response 144 500 12

4.5.2 Participants Anchored their Estimates

Sub idea: Participants are estimated based on the points, not based on the visually fitted trend. This is stronger in QE2.

4.6 Absolute deviation

4.6.1 True Value

scale variable n median iqr
linear abs_deviation 301 381.62 463.23
log2 abs_deviation 301 22.39 12.00

4.6.2 Closest point absolute deviation

scale variable n median iqr
linear closest_pt_abs_deviation 301 345.48 411.38
log2 closest_pt_abs_deviation 301 45.10 21.41

5 QE2: Estimate a year given a population

5.1 Question

q_id creature qtext true_value
QE2 tribble In what stardate does the population of Tribbles reach 4,000? 4528.45
QE2 ewok In what ABY does the population of Ewoks reach 4,000? 28.45

5.2 Closest Points

x y0 dataset y
27 3369.38 dataset1 3010.82
25 2661.12 dataset1 3064.85
26 2994.03 dataset1 3169.40
28 3792.59 dataset1 3228.14
24 2365.86 dataset1 3774.90
30 4807.77 dataset1 5174.12
25 2661.12 dataset2 2746.12
28 3792.59 dataset2 3859.22
27 3369.38 dataset2 4099.69
29 4269.76 dataset2 4423.01

5.3 Data

QE2 data set example
participant_id dataset scale response true_value deviation abs_deviation closest_pt_value closest_pt_deviation closest_pt_abs_deviation
0f7fc4ff03ad53f80b84cc62c1644648 dataset1 log2 24 28.45 -4.45 4.45 24 0 0
0f7fc4ff03ad53f80b84cc62c1644648 dataset2 linear 27 28.45 -1.45 1.45 27 0 0
5b16d305db2092ddae8cf1c410341f36 dataset1 log2 24 28.45 -4.45 4.45 24 0 0
5b16d305db2092ddae8cf1c410341f36 dataset2 linear 25 28.45 -3.45 3.45 27 -2 2
8ab3438eb60817740bdd15143ceacd06 dataset2 log2 28 28.45 -0.45 0.45 27 1 1
8ab3438eb60817740bdd15143ceacd06 dataset1 linear 28 28.45 -0.45 0.45 24 4 4

5.4 Exploration

5.5 Main Take Aways

5.5.1 Accuracy

  • About the same on both scales, maybe a slight tendency to overestimate (maybe due to estimating the “visual trend” estimate on the log scale as indicated by data set 1?).
  • Not sure there is enough evidence to claim participants were more accurate on the linear scale, but would like to do more studies focusing on participants ability to read between the y-axis tick marks on the logarithmic scale. They could also be anchoring to the tick mark of 4096.
dataset scale variable n median iqr
dataset1 linear response 141 24 1.0
dataset1 log2 response 154 24 3.0
dataset2 linear response 155 27 1.5
dataset2 log2 response 139 27 1.0

5.5.2 Participants are basing estimates on the simulated data points and not on a visual trendline

  • but… based on the density plots above, on the log scale, participants might have a tendency to be fitting a visual trend first and then estimating as indicated by the overestimation on the log scale for data set 1.

6 QI1: Estimate an additive increase in population between two years

q_id creature qtext true_value
QI1 tribble From 4520 to 4540, the population increases by ____ Tribbles. 14363.34
QI1 ewok From 20 ABY to 40 ABY, the population increases by ____ Ewoks. 14363.34

6.1 Closest Points

dataset 3020 3040 increase
dataset1 1529.18 17046.94 15517.75
dataset2 1288.91 24186.34 22897.43

6.2 Data

  • Truncate data at 30000.
QI1 data set example
participant_id dataset scale response true_value deviation abs_deviation closest_pt_value closest_pt_deviation closest_pt_abs_deviation
0f7fc4ff03ad53f80b84cc62c1644648 dataset1 log2 14848 14363.34 484.66 484.66 15517.75 -669.75 669.75
0f7fc4ff03ad53f80b84cc62c1644648 dataset2 linear 23000 14363.34 8636.66 8636.66 22897.43 102.57 102.57
5b16d305db2092ddae8cf1c410341f36 dataset1 log2 13000 14363.34 -1363.34 1363.34 15517.75 -2517.75 2517.75
5b16d305db2092ddae8cf1c410341f36 dataset2 linear 2400 14363.34 -11963.34 11963.34 22897.43 -20497.43 20497.43
8ab3438eb60817740bdd15143ceacd06 dataset2 log2 14800 14363.34 436.66 436.66 22897.43 -8097.43 8097.43
8ab3438eb60817740bdd15143ceacd06 dataset1 linear 13500 14363.34 -863.34 863.34 15517.75 -2017.75 2017.75

6.3 Exploration

  • Quite a few responses in the 10 - 30 range??

6.4 Main Take Aways

6.4.1 Accuracy

  • Tendency to underestimate the difference (for closest point) and tendency to overestimate the difference (for true value).
dataset scale variable n median iqr
dataset1 linear response 142 15000.0 2975
dataset1 log2 response 156 14784.0 2000
dataset2 linear response 153 17000.0 11000
dataset2 log2 response 134 15445.5 8240

dataset scale variable n median iqr
dataset1 linear closest_pt_deviation 142 -517.75 2975
dataset1 log2 closest_pt_deviation 156 -733.75 2000
dataset2 linear closest_pt_deviation 153 -5897.43 11000
dataset2 log2 closest_pt_deviation 134 -7451.93 8240

6.4.2 Anchoring & Reading Points

  • For example, 16384 - 1024 = 15360, but that 15000 is still strong.
  • Data set 2 has higher estimates (aka reading the points).

7 QI2: Estimate a multiplicative change in population between two years (i.e. how many times larger)

q_id creature qtext true_value
QI2 tribble How many times more Tribbles are there in 4540 than in 4520? 10.68524
QI2 ewok How many times more Ewoks are there in 40 ABY than in 20 ABY? 10.68524

7.1 Closest Points

dataset 3020 3040 increase
dataset1 1529.18 17046.94 11.15
dataset2 1288.91 24186.34 18.76

7.2 Data

  • Truncated at 30000, due to misunderstanding.
QI2 data set example
participant_id dataset scale response true_value deviation abs_deviation closest_pt_value closest_pt_deviation closest_pt_abs_deviation
0f7fc4ff03ad53f80b84cc62c1644648 dataset1 log2 16.0 10.69 5.31 5.31 11.15 4.85 4.85
0f7fc4ff03ad53f80b84cc62c1644648 dataset2 linear 17.0 10.69 6.31 6.31 18.76 -1.76 1.76
5b16d305db2092ddae8cf1c410341f36 dataset1 log2 32.0 10.69 21.31 21.31 11.15 20.85 20.85
5b16d305db2092ddae8cf1c410341f36 dataset2 linear 500.0 10.69 489.31 489.31 18.76 481.24 481.24
8ab3438eb60817740bdd15143ceacd06 dataset2 log2 11.6 10.69 0.91 0.91 18.76 -7.16 7.16
8ab3438eb60817740bdd15143ceacd06 dataset1 linear 12.5 10.69 1.81 1.81 11.15 1.35 1.35

7.3 Exploration

7.4 Main Take Aways

7.4.1 Basic lack of understanding

  • Describe logic from calculation and scratchpad.
  • 15000 was still a common response.

7.4.2 Accuracy

  • Larger variability on linear scale.
dataset scale variable n median iqr
dataset1 linear response 145 11.70 8.5
dataset1 log2 response 156 10.69 6.0
dataset2 linear response 156 15.15 14.0
dataset2 log2 response 145 16.00 8.5

7.4.3 Common points

  • Not as strong of an anchoring sense here.
  • Appears to be reading the points.

8 QI3: Estimate the number of years necessary to double the population

q_id creature qtext true_value
QI3 tribble How long does it take for the population of Tribbles in stardate 4510 to double? 6.245448
QI3 ewok How long does it take for the population of Ewoks in 10 ABY to double? 6.245448

8.1 Closest Points

From QE1, the estimated population at 10 is:

x y0 dataset y doubled
3010 481.62 dataset1 445.48 890.97
3010 481.62 dataset2 466.90 933.79
x y0 dataset y doubled pop_diff year_diff
3014 747.52 dataset1 786.81 890.97 104.15 4
3013 668.65 dataset1 723.92 890.97 167.04 3
3016 936.72 dataset1 1073.52 890.97 182.55 6
3019 1320.97 dataset1 1074.29 890.97 183.32 9
3016 936.72 dataset2 1028.59 933.79 94.80 6
3013 668.65 dataset2 819.66 933.79 114.13 3
3017 1049.78 dataset2 809.55 933.79 124.25 7
3015 836.45 dataset2 750.03 933.79 183.76 5
3014 747.52 dataset2 735.97 933.79 197.82 4

8.2 Data

QI3 data set example
participant_id dataset scale response true_value deviation abs_deviation closest_pt_value closest_pt_deviation closest_pt_abs_deviation
0f7fc4ff03ad53f80b84cc62c1644648 dataset1 log2 6 6.25 -0.25 0.25 4 2 2
0f7fc4ff03ad53f80b84cc62c1644648 dataset2 linear 10 6.25 3.75 3.75 6 4 4
5b16d305db2092ddae8cf1c410341f36 dataset1 log2 8 6.25 1.75 1.75 4 4 4
5b16d305db2092ddae8cf1c410341f36 dataset2 linear 12 6.25 5.75 5.75 6 6 6
8ab3438eb60817740bdd15143ceacd06 dataset2 log2 7 6.25 0.75 0.75 6 1 1
8ab3438eb60817740bdd15143ceacd06 dataset1 linear 5 6.25 -1.25 1.25 4 1 1

8.3 Exploration

8.4 Main Take Aways

8.4.1 Accuracy

  • Larger variability on linear scale.
  • More accurate on log scale??
dataset scale variable n median iqr
dataset1 linear response 136 5 5
dataset1 log2 response 144 5 2
dataset2 linear response 147 8 6
dataset2 log2 response 136 6 2

8.4.2 Common points

  • Strong anchoring at 5 and 10.